This master?s thesis presents experiences from an evaluation of AdApt, a multi- modal, conversational dialogue system, using PARADISE, PARAdigm for Dialogue System evaluation, a general framework for evaluation. The purpose of this master?s thesis was to assess PARADISE as an evaluation tool for such a system. An experimental study with 26 subjects was performed.

The client, Senselogic, had noticed an increased demand for an e-commerce system integrated into its product, SiteVision, something that did not previously exist. Senselogic wanted to integrate a third-party system to manage e-commerce. The problem was that there were very many e-commerce solutions to choose from. In order to select the best system it was necessary to evaluate the e-commerce systems and compare them to each other. To identify the elements that has to be included in an e-commerce system a study of literature was conducted.

This study aims to examine the effect the evaluation system used by the Stockholm County Council, has on how the healthcare providers themselves conduct the evaluation regarding their own operations. This is done through a qualitative case study of the evaluation systems of the Stockholm County Council and of four primary healthcare producers concerning one primary healthcare contract. The evaluation systems were analysed using Merchant and Ver der Stede's (2007) framework for different types of control. In order to give a more detailed picture this framework was complemented with different types of performance measurement. The evaluation that the Stockholm County Council conducts was found to have little influence on the providers own evaluation with the exception of the quality indicators that are rewarded with a monetary bonus..

 This report is an evaluation of Peab's purchase and call-off system, PIA.PIA is used to order goods for Peab's construction sites. The background to the work is that users of the system have understood the system cumbersome to use when purchasing goods for construction sites. The evaluation was carried out by the interviews and tests with users of the program, in this case, supervisors and site managers at the company. Ten users of the system were interviewed and eleven people have carried out a test order.The focus is primarily on the test order that users have implemented, which has been clocked and analyzed for time and cost. The evaluation is also a user analysis concerning how the users perceive the program, mainly in terms of usability, functionality and benefits.The result of this report shows that PIA is economically profitable to use for the purchase of goods for construction sites.

This is a heuristic evaluation of Umeå university library?s Online Public Access Catalog (OPAC). It makes use of four of Nielsen?s ten heuristics, flexibility and efficiency to use, match between the system and real world, visibility of system status, and aesthetic and minimalist design. The evaluation was done by having 3 evaluators inspect the interface individually, as per Nielsen?s (1990) recommendation of 3-5 evaluators.

Organisations and projects use CSCW/Groupware systems for collaboration purposes. These systems and applications are in many cases using a non-transparent GUI, witch is also hard to learn. This paper present a novel system that aims towards being transparent and easy to use. This system, called CollMX, will be evaluated and different ideas for future development will be presented.  The evaluation and ideas are generated by an empiric evaluation and research in different areas related to CSCW. The research does not only focus on the area of CSCW, but also extends towards the Web 2.0 and ideas about awareness..

Today, there are no standardized ways to characterize SOA, many are talking about SOA and many say they are using SOA. One way that we have chosen to characterize this phenomenon is through an evaluation that will indicate whether SOA have been used in the development. Basedon a Service Oriented Architecture literature study, we have created an evaluation pattern resulting SOA principles of integration, architecture and services. This evaluation was applied to Logica's own integration system AgrCom through an empirical study to result in a response indicating whether AgrCom is SOA based. The results of the evaluation show that AgrCom is part of an SOA solution but not an SOA as a whole concept.

The numbers of mergers and acquisitions have increased significantly in the last period of time. Although this popularity for mergers and acquisitions, most of the mergers and acquisitions fail to create value. One explanation to this failure of value creation is, according to several studies, how companies treat integration of information systems in the pre-merger evaluation. The research within the field argues that information system integration should have a proactive role in mergers and acquisitions, meaning that information system integration should support the organizational change and normally be considered in the premerger evaluation. The aim of this thesis is to study issues that affect whether companies choose to consider information system integration proactively, when involved in mergers and acquisitions.

In Sweden the breeding organization for the Swedish Warmblood horse uses a traditional scoring system when evaluating horses. The horse is scored subjectively in relation to how good each trait is in relation to the breeding objective. Other countries, for example the Netherlands, instead use a linear scoring system. The linear scoring system evaluates the horse on a scale between two, for the breed, biological extremes which makes the evaluation more objective since the judges personal values does not influence as much. The breeding organization for the Swedish Warmblood is today planning a change towards a linear scoring system.

Within system development users have rarely been involved or received much attention during the development. Most of the times, the primary focus within system development lies on insuring functionality, rather than making the system usable. The literature specifies that a non user-centered approach can contribute to a product with low usability, which can lead to an ineffective and unsatisfactory experience for the end users.The purpose of this thesis is to begin an investigation to see if the use of non user-oriented system development methods is a possible cause of low usability in the final system.To achieve the purpose of this thesis, we have conducted a case study. Within the case study we examined the usability of a time reporting system. The case study included seven minor studies; an investigation concerning the development of the system, an expert evaluation of the system, interviews and observations of users, developed paper prototypes and executable prototypes, both which user testing was performed on.The result of this study shows that by working with user-entered methods, the usability in the time reporting system increased after the design had been revised.

The research objective of this thesis was to conduct a holistic evaluation of an operational information system. By holistic evaluation we mean that an equal focus was placed on both the system system perspective and its users user perspective, in the actual environment where the system and its users function contextuality. In addition, the methodological objective of the study was to test a new research approach in a real life setting. The participants of the study were twenty newspaper journalists employed at Göteborgs-Posten GP. The information system NewsLink is a manually indexed full-text database containing all articles published in GP since 1994.

This thesis evaluates the user board of the elememtary school in Veberöd, Sweden. In this process an evaluation model is developed. The model itself gets evaluated in a meta-evaluation to improve the model for future use.The starting point of the evaluation is the deliberative democracy theory. Although Sweden is a representative democracy an official desire exists to have a democracy with deliberative qualities. The evaluation model is constructed to fit this context and is therefore, not only, set out from classical goal-based evaluation but also from deliberative democratic evaluation.

The main subject with this master thesis is to take a closer look on how some of the university libraries of Gothenburg have evaluated their electronic services (such as search-systems, Internet-based services, CD-ROM etc.). The information technology has made its way into the library field during the past century and needs to be evaluated and quality measured to ensure the best possible service to the users. Since evaluation of electronic services is a new area in the evaluation field, some problems has arisen in terms of choosing evaluation strategies and finding the appropriate performance indicators for the evaluation process. The main questions asked in the thesis are; - Which are the most common theoretical strategies for evaluation? - How do some of the university libraries of Gothenburg perform evaluation in practice? - How does the various strategies for evaluation apply to the context of this thesis? The results show that specific strategies for evaluation aren't used in the reports discussed in this thesis.

Problem discussion: Long-term supplier relationships have become more common. Hence, supplier evaluation is a critical activity for many companies. However, making a relevant supplier evaluation is time consuming. Therefore, it is important to decide which of the suppliers to put an extra effort on. Should all suppliers be evaluated in the same way? Previous, focus has been on purchasing of direct material.

The aim of this master thesis is to evaluate the performance of the content-based image retrieval system ImBrowse from a semantic point of view. Evaluation of retrieval performance is a problem in content-based image retrieval (CBIR). There are many different methods for measuring the performance of content-based image retrieval systems, but no common way for performing the evaluation. The main focus is on image retrieval regarding the extraction of the visual features in the image, from three semantic levels. The thesis tries to elucidate the semantic gap, which is the problem when the systems extraction of the visual features from the image and the user?s interpretation of that same information do not correspond.